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(57) A secondary packetized data stream (IS), such 
as a commercial, is spliced with a primary packetized 
data stream ( (MS), SUC h as a network television pro- 
gram. The system does not require decompression of 
the data in the primary data stream, and is particularly 
suitable for use at a cable system headend to allow the 
insertion of commercials from local businesses into a 
nationally broadcast television program. When a start 
signal (T_in)is received, a pre-splicing packet (700, 800, 
900, 1000) of the primary stream is determined. The 
pre-splicing packet is the packet closest to the start time 
which carries an anchor frame (e.g., I or P frame) start 
code (706. 804, 905. 1003). To prevent a potential dis- 
continuity at the decoder (168). the pre-splicing packet 

|T_In 



(700, 800, 900, 1000) is processed ; to discard the: 
anchor frame data, and to insert a number of stuffingj 
bytes (712, 812, 912, 1012) which is equal to the! 
number of bytes discarded into an adaptation field of the! 
pre-splicing packet. To further maintain continuity at the 
decoder, identifying data of the primary stream such as 
PID and PSI data, is retrieved and provided to the sec- 
ondary stream. A number of null packets (430) are 
inserted into the output stream (OS) at the transition 
point between the main program and the commercial to 
prevent a buffer overflow at a decoder (168) which 
receives the output stream (OS). 
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Description. ■ - a 

BACKGROUND OF THE INVENTION > , '\ : * : r - : , : , 

The present invention relates to -the communication of digital video signals, and more particularly, to the insertion 
of digital video messages such as commercials into a pre-existing compressed packetizeddata stream. Data packets 
of the - commercial message are spliced jnto a pre-existing data stream (complying, e.g.; with the Moving Picture 
Experts Group (MPEG),transmissipn,standard) without decompressing the data in the data stream, and while maintain- 
ing compliance with the MPEG or similar digital data communication^protocol. . 

. . Digital transmission schemes are particular!/ advantageous for signals that are broadcast from a main office by 
satellrte to a cable television affiliate at a system headend: At .the system headend, the digital data stream may be fur- 
ther processed and distributed to.the cable system customers, for example, via a Hybrid Fiber Coax (HFC) or Fiber to 
the Curb (FTTC) network. Such an arrangements known as an end-to-end digital' network since digital video is com- 
pressed and transmitted from a programming source -at a central office all the way to each customer's home. In an HFC 
network, a distribution line includes both a coaxial cable which carries radio-frequency signals, and an optical fiber 
which carries light wave signals. In aJHTC network, an optical fiber carries theiciata stream from the cable system 
headend to a neighborhood transfer point,.or drop, and conventional coaxial cable carries the signal ; from : the dror>to 
the customer's home. AMhe customer's heme, ;a decoder processes the digital signal to provider signal for display on ; 
a television^ other- display device. , -v r><T : * L . . t . . , t . . ■ ^ . >; 

>. ; In suchcabl^distribution systems^ the received data.stream may be processed at the headend prior to distribution . 
to the system^customers. T( !n particular, commerciatmessages from local businesses ; may be inserted into the main pro-, 
grams. However, in order to accomplish this, conventionally the received digital data stream must be completely demod- : 
ulated. demultiplexed, decrypted, decompressed and decoded to recover the signal in the analog domain. Then, the 
desired commercial message is provided in the analog-domain and- inserted, into the signal to provide a new analog 
combined signal. Finally, the analog combined, signal isrdigitized, encoded, compressed^ encrypted, multiplexed and 
modulated for transmission to a customer's home. As can be seen, this process leaves much to be desired as it requires 
a number of time-consuming steps that must be implemented with additional hardware, including magnetic tape record- 
ers and players. Moreover, a large magnetic tape library must be maintained andindexed. Furthermore, the conversion , 
from digital to analog and back to the digital domain may result in degradation of the signal quality! 

s-rP?W8* h^^^^F^^-prq^e a system for,ailowiqg an auxiliary compressed digital signal such as a com- 
mercial message to be inserted into a compressed digital signal of a main program without requiring decompression of 
the dam in the main program signal. Such a system shoujd allowiCable system headed operators to conveniently ihsert 
commercial messages into a main program which is received, for example, via a nationwide or international satellite dis- - 
tribution network. Additionally, the, system should not, degrade the^quality of the main program. In particular, the system 
should avoid any discontinuity which resultsjrva nonheornpliantdata stream. Thesystem should also preclude problems 
such as syntax violations, decoding errors, buffer overflow or underflow, timing recovery problems due to discontinuous 
system time stamps, .audio/video synchronisation problems,: snd .video display artifacts,- Furthermore, the system 
should be compatible with MPEG and similar digital data communication standards, in addition to being fully compatible < 
with existing decoder technology. The present invention provides a system having the above and other advantages: 

SUMMARY OF THE INVENTION " ."v."". ^ . ■ " " A / . " " >^ : ^ 

c In, accordance, with the present invention,, a method and apparatus are presented for splicing a secondary pack- 
etized data stream, such as a commercial, with a primary packetized data stream, such as a network television pro- 
gram, - Advantageously, the system does not require the decompression of the data in the primary data stream, and is 
particularly suitable for use at a cable system headend. . : i: ,-. -, sor.-. i r - - 

. A start signal is provided to indicate the time to initiate the splicing, that is, when to insert thercommercial. The start 
signal may be embedded as data in the main program, in which case it must be recovered.- Alternatively, the cable sys- . 
tern operator may provide an external time signal. In either case, once the start signal has been received, a pre-splicing 
packet of the primary stream is determined. Normally, the pre-splicing packet is the packet, closest to the start time - 
which carries ar». anchor frame start gode : The anchor, frame start code indicates that "data of an;l or-JP -frame is carried 
in the packet. Typically, such a packet may carry data from the I (or P> frame, and the frame which immediately precedes 
the \ (or P) frame. To prevent a potential .discontinuity at the decoder.-the pre-splicing packet is processed to discard the 
anchor frame data, and to insert a number of stuffing bytes which is equal-to the number, of bytes discarded into an . 
adaptation field of the prersplicing packet,, An : adaptatiqn field is created if it does not already exist. - L , ; - 

Additionally, to maintain continuity at the decoder,' identifying dataof-the primary stream such as PID and PSI data, - 
is retrieved and provided to the secondary stream. 

Furthermore, it may be necessary to insert a number of null packets into the output stream at the transition point 
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between the main program and the commercial. In particular, a number L of null packets are provided in the outpui r 
stream to prevent a buffer overflow at a decoder which receives the output stream. The null packets are inserted 
between the pre-splicing packet of the main program and the first packet of the commercial. Similarly, when there is a 
transition back from the commercial to the main program, additional null packets may be inserted. The number L is 

5 determined according to the.data rates of the primary and secondary streams; andfprovides* a corresponding paddfng 
delay time which reduces the. decoder's buffer level. . < ■= r 

c Also, at the transition back frorrvthe commercial toihe main program, a post-splicing packet of the main program 
which follows the pre-splicing packet is determined. Typically, the post-splicing packed will have a sequence' start code * 
which follows the sequence end code which is associated with the last packet bf the' commercial. The post-splicing 

10 packet is positioned to follow the last packet of the commercial in the output stream. Moreover, processing of thepost- 
splicing packet is analogous to processing of the pre-splicing packet. Specifically, datafn the post-splicing packet which' : 
is associated iwith an immediately preceding packet, which' m&y or may hot be the same as the pre-splicing packet", is 
discarded to prevent a discontinuity at the decoder. Moreover, an amount of stuffing data is added to an adaptation field 
of the post-splicing packet based on the amount that was discarded.- An adaptation-field is* created if it does not already 

is exist . i- r ■ »i .. : ■• . •> . r ; 

A corresponding apparatus, including an insertion processing module, is also presented. 

A decoder is also presented for decoding a transport data stream which com^rise^ a main prdgram and a commer- 
cial The decoder includes"a buffer for storing thetrarisport datS'-Tn^' buffer Has a ■size : ihai is modeled at thelrisertioh 
processing unit by a virtual buffer scheme. A processor is coupled to receive data from fhe buffer for processing to pro- j 
20 vide a signal which is routed to a' television fof display of the main ^bgr&rtf and frie Commercial, in turnr A number 'L of 
null packets are prdvidedbetween arpre+splicing packet of the jnairtfTro^ram aMa f iristpafcfkef of the commercial tc^pre- 
vent overflow of the buffer. In particular, the number L is determined acco?dinc| to theiYespecti\/e data rates of the main 
program arid the commercial. 'Additionally, L may be'determirfed according to a d^fcodihg^delay time of the : decdder t and : 
according to a padding delay which prevents ai dscbdingdiscorifinuify. The decoder provides^ signal for displaybn a* 
25 display device such that a transition between the main program and the "commercial, and backagair?, is substantially" 
seamless;'. ' : ~.>- ~>-» '-v . . ; . . c . . i j * 

• - : < 3 i . r J : j \, --kr- -*v.m. • ' -'-'i " 

BRIEF DESCRIPTION OFTffE DRAWINGS ^ .< ~ • • • - 

'? -r *M . ;i'JL-.. • ■ -<-■■ S i v ..Si tro c A. •>'•?: i 

30 FIGURE tfe a block diagram of a FibeMo-the-Curb Digital* Video -Distributiohlsl^twc^ 

present bitttttlarr. ?o ^-.j^ .uci < ne^-cv^ry *\i *\o ^mi.; : - ^??zz<r->^f --fni fcsMesS e-J oi ^.r^an 'xp.pr- 

1 FIGURE ^Isa^block cfiagrafn'of a r +lybN8 Fiber 06ax Digital Video Distribution-Network macdDrdarice with tlhe 
preset 1rtte6nti6n. v/n -et r : ter- .<< >ot -'if . a n '< v- ,\ ■«= ;= a :/ ' i. ... * 

FIGURE 3 is block diagram of a Digital AdJhSeaiblS ^criufe in accordance witrfthe present invention. 
35 FIGURE 4*is a block diiagranvof an hisertiorY Processing 1 Uhif>6f tf Digital Ad Insertion Module in accordance with 
the present ihvSntibn.v r ■ i • \ ir vo^ . » v x-, -j'Iw.d > or.:, t^'v ■' . ; "s .'r:.i. 

FIGURE 5 illustrates' the ^rcte6ssfeiog f low *bf 'thelhisertioh^ Prisces^ing Unit of FIGURED in accordance with the 1 : 
presentiriventioM ■ '-i-. J"' ^ r» ^m.-^ .-Ur^ru n= — - s:^ ; >b v::: • r r. ...r 'V r^.,v:- : ■ v 
FIGURES 6a to' 6c are diagramm^cvillustratidlfts showing how VariablieHengfth PES packets are reorganized into 
40 fixed length transport packets for use in providing a transport multiplex for transmission. 

FIGURES 7a-7d show a pre-splicing data packet having an adaptation field and PES Meacterr^efbre and after 
processing in accordance with the present invention. 

FIGURES &a and Sb showa'pre'Splicing data packet having an adaptation field but noTES header beifbre anef after 
processing in accordance with the present invention. ^ ' v * : ,v '' ;: *: - 

45 FIGURESSa-Sd'fchow a x pre-splicing data jacket having+io adaptation^ ield btitwith a PES header before and after 
processing in accordance with the present invention. ^ ^ - £ . 3 , . -j • - : ^ 

FK3UFIES 40a and 10b show a pre-splicing data packet having no adaptation fietcPdr^PES header before and'after 
pro€&ss1nc^rn:&Gordati - ; ^ . ■ v - - . 

. FlGUflES 4 fa^1 1^d-shbw a post-splicihg data packet : havihg art adaptation field and PES header before and Sfter ' * r 
so prdcessi^in accdrdahttef with the present invention. >~ t !V.' v . ^ :<\ :?\ .i 1 x c ™ • : _ ,r 

" FIGURES"T2a and 12fe shoW l & post-splicing dSta^acket' having Sri adaptation field but ho PES header before and : *' 
after pttJcfcssing in actord&nce with the present invention.* ^ ; » f - : v » ; , - r.: v~ 

FIGURES -13a-13d show a post-splicing data piacket- having no adaption field but with a : PES header before ^and'- 
after processing. in accordance with- thfe prefeeYit inverftton. = • '■'"-> - - - ' ^ : > 
55 FIGURES 1 4a and t4b show a pdsfcfcpltcing data packet having no adaptation field or PES header before arid after 
processing in accordance with the present inventibn. i\ % ' -»:*.; ^ ^ ; . s~ - 



3 i 



EP 0 837 609 A2 



DETAILED DESCRIPTION OF THE INVENTION 7 t !; tI 

A method and apparatus-are presented for splicing a secondary packetized data stream, such as a commercial, 
with a primary packetized data stream, such as a network television program. ■ . * 

5 FIGURED is a block diagram of :a Fiber-to-the-Curb' Digital Video Distribution Network in accordance with the 

present invention. The-distribution network includes Video Information Providers (V IPs) shown generally at 100, a gate- 
way, shown generally at 120, an access network, shown generally at 140, and the home of a Video Information User 
(VIU), shown generally at 160. The gateway 120 may comprise an : L1 Gateway manufactured byrTeleco. The VIPs,rnay 
include a video server 1 02 i; an interactive data server 104. and an internet gateway 106, all of which communicate with 

10 an asynchronous transfer mode (ATM) network 122 via, for example, an OC-3 system, whereoptical fiber is used to 
transmit data at 155.52 Mbit/sec. The ATM network 122 may also receive data via a satellite receiving antenna 110, 
broadcast encoder and server 1 1 2, and ATM.muItiplexer 1 14. The ATM network 1 22 communicates with a session man- 
ager^ 23.- - : , . j : <. \ s\ H \ 

The ATTyi network 122 may provide information to one or more access^networks, such as a cable television distri- 

15 bution headend 140. First, however, the information; from the ATM.network is processed via a Digital Ad Insertion Mod?; 
ule (DAIM) 130 in accordance with the present invention .^Information, .such as a network television program, passes; 
between the ATM network 122 and the DAIM 13&via-an ATM receiver (Rx).interface,(l/F) .124. The : DAIM 130 receives 
the information as a;compresseri digital packetized data strearn and accesses an inserted stream storage unit 135. ; The 
storage unit may include a-digitized library qf advertisements (e.g., commercials) which are, available to insert into the 

20 netwprJk . television ;prpgrara Trie storage unit 135tfnay include digital, audio, tapes (DATs), digital video disks (DVDs), 
compact.aujdio discs (CDs) or other .magnetic or optical storage, media. : -c,. *. 

In accordance with the present invention, the DAIM 130 inserts a compressed digital packetized advertisement 
stream Jnto /the compressed digital packetized data stream of the network television program without decompressing 
the program. Moreover, when the television program is in an MPEG-2 or similar format -the DAIM maintains compliance 

25 with the MPEG-2 protocol. Of course, while the embodiment of FIGURE 1 is particularly suited for the insertion of 
advertisements into a network television program, there are many/other useful applications, including the insertion of 
educational programming, emergency messages such as>weather bulletins. ^informational messages from the cable 
system operator, and the like. Furthermore, audio only or data only messages may be inserted into the main packetized 
data str^m vl Moreoyer^^e. s^me message may be inserted into more than one main program, at the same time, and 

30 differggt^essag^ l ^ J; ( ; ; 

^-conipr^ssed digrtalir^cketized^data stream which includes thejnserted message: ^.combined with the main pro- . 
gram is output from the^DAIM 130 to an ATM transmitter (Tx) interface 126/and then provided to an. access network 
(e.g.,.cabie system headend) 14Q, !n the. access, network 140, a ; Host Digital Terminal* (HPT) t44 receives the data' 
stream and also receives .control signals frqm.an element-manager 142, which manages the cable network The HDT 

35 144, which : is a specialized digital switch which is typicattyjocated in s head office.of the cable system, communicates 
with one, or more Optical Node Units f (ONUs),jncluding.ONU 146. The ONUjsjooated in; the local curb, and supports 
an optical to electrical conversion and modulation/demodulation. The ONU 146 then provides the data stream over a 
coax distribution. network tpon^or more subscriber's homesor offices. At eachchome; a drop box 164 located near.the 
home receives the combined digital signal and provides it to a Digital Entertainment Terminal (DET) (eg.-; decoder) 1 68 

40 and a Network Interface Module (NIM) 166. The DET decodes the packetized data stream, and the signal is seamlessly 
delivered for display to the Video Information User (VIU) (e.gt, subscriber);^ televisions 1 70, 1 72 and/or personal com- 
puter174. ^ . . . ; . £ , r- . v 

FIGURE 2 is a block diagram of a Hybrid Fiber Coaxi Digital Video Distribution Network in efccordance with the 
present invention. Like-numbered elements correspond to the elements of FIGURE l^iThe distribution network includes 

45 a satellite uplink, showrv general jy at 200, a satellite downlink, shown generally^ 240, an access network 140 and a 
VIU's home 160. The satellite uplink 200 includes a broadcast encoder and server '205, which may also perform an 
encryptioafunction, an MPEG multiplexer 210, a modulator 215, and a transmitting antenna 220. The satellite downlink 
240 includes a receiving antenna 242, and an integrated receiver 244v The signal received,at the antenna 242 typically 
comprisesra multiplex of encrypted channels (e.g., one, hundred or more channels) from various programming service 

so providers. The received multiplexed signal is processed at the integrated; receiver 244 by ^demodulator 246 and! 
decryption function 248. '•<.-,..* ^ ^ . : ? . • ^ . • ^ ,i ; :: 

The recovered multiplex of channels is then, provided to, the D^fM 250 for processing in accordance" with the 
present invention. The DAIM accesses an inserted; stream storage unit 13j5 to retrieve a compressed digital packetized 
message for insertion into one or more main channels of the multiplex.: After processing by *the DAIM,, the one or more 

55 combined signals are received by a transcoder 260 for encryption and/or modulation at junction 265. as well known in 
the art. The multiplex of signals, including the signal with the inserted messages, is then received by the access network 
1 40 and transmitted to the.subscribers t tiomes for djsplay at the VIU's home .1 60 as discuss^d in connection with FIG- 
URE. 1.-,, f y. s v 2t . c . , vv . ■ ■ - . ^* r: , -'(*..!': t =;'>::.:..• Y , . . ' 1 .} 1 "> -T- ■ . * r 
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FIGURE 3 is a block diagram of a Digital Ad Insertion Module (DAIM) in accordance with the present invention- 
Advantageously, the DAIM 300 is compatible with existing communication networks, including the Fiber-to-the-curb net- 
workof FIGURE 1, and the Hybrid Fiber ,Ooax network of FIGURE 2. The DAIM receives:a main stream (MS) which 
comprises a primary data stream such as a network television program,, and an insertion stream (IS), which comprises " 

5 a secondary data stream such as a commercial message/ Within therDAIM, an external control interface 31 0 commu- 
nicates with an Insertion Processing Unit-(IF?U) 400. After the commercial message is inserted into the main stream, an- 
output stream is produced. ; . ? -'- 

FIGURE 4. is a block diagram of an Insertion Processing Unit (IPU) f of aDigital Ad Insertion Module in accordance ' 
with the present invention. The IPU, shown generally at 400. received th6 main stream at a r packet framer 405, while the : 

io insertion stream is received at another packet framer 4 10V After processing by the packet framer 405, the main stream ' 
is provided to a Main Stream Parser (MSP) 415. The MSP also receives an input labeled t_in, which' is the desired' 
starting time of the insertion of the insertion stream into the main stream. Similarly, after processing by the packet 
framer 410, the insertion stream is provided to an Insertion Stream Parser (ISP) 420. The ISP also receives an input - - r 
labeled T_out, which is the desired ending time of the insertion of the insertion-stream into the main stream. TJn may 

15 be carried in the main stream, or it may be provided locally, such as at the cable system headend. Similarly, T_out may 
be carried in the main stream, insertion stream, or may be generated locally. c 

The mainstream- parser 415 parses the data packets of the main stream arKd-provides-signals to a video buffer " 
manager 425. These signals include a Program Clock Reference <PCR>, a Deetodirfg Tiifnfe Sitarrip (DTS)i and a video r ; 
bit rate, H^y) for the main stream. Similarly, the insertion [ stream p^f&er J 420 '^afees^he data* packets of the insertion J,; 

20 stream to provide PC R\ DTS* and R_v- signals to the video bulfer : manager 425, wtiere the prirhe dotation indicated a v -- 1 
parameter of the insertion stream. The video buffer manager 425 usds-tftennpat sigrihls'to determine' a numberf N : , ! bf r o: 
null packets which will be inserted into the output data stream. \n particular, f to avoid 1 a decoder buffer overflow," it may 
be necessary to add null packets: to the output stream dur(h§4h6 transition from -the -main to the insertion stream', arid 
during the transition from the insertion to the main stream, if th§ insertion stream has a higher data rate thari* the main 

25 stream. The number of null packets' is provided to a null packet generator 430 aridthen to a Data Buffer (DB) 485 wHich i£ 
ispartof an output buffer 475. The DB 485 communicates with a syntax pro'cessfcr^70. - *.v.:-. \ 

The main stream parser 415 provides the main stream data to a main stream buffer 480, which communicates* with ' ^ 
a syntax processor 470' The main stream buffer 480 is part of the output : buffer 475. The insertion stream parser 420 H ; ^ 
provides the Insertion stream, data to^a Program Specific Information (PSI)/Program Identifier (PIO) ■ Replaced 435, ' ;a 

30 which replaces the PSI tables and PIDsiof the insertion stream with those of the main x ^r^m~W6 ^ PS^/P-ll^ ^ i^ptacfer , : ^ ;h 3 
435 retrieves the relevant»information from theimaTn £tr66rn using a comifiuhicatiorfpi^ 

and Pl&dataofcthernaiastrea'm p^ - i& 

ticular programming service; Specif ically, this is^dcoffiplisheti using a Pro^aWAss6ciatibn Table (PAT) and a Program f & 
Map Table (PMT). The insertion streams thertfprovkiedtb ah Insertion Stream Buffer (ISB) 490;^^ is pari of;*the ' t& 
35 output buffer 475. The fSB 490 communicates with a syrrta* frofce^St 1 47o: : Furtherfadre? the output buffer 475 receives v r v# 
commands^from a buffer-controller 465 to provide an output strfearti with the iNsertiorffetreariri seamlefssly'spliced ihto -\ 
the main streams ' ^>^;*rt i ■ \ ~ ..-.ci* 1 :^-; av..:^v-' ! f- ^no., , -.v.: - ^ <. f - ■ - 

Further details of tffe various >elements'ctf the hfeertibfipr6cessin§ uffit 400 of FIGURE-4wai how be flisdussed? The 
following terms and variables wiirbe usectefi -vi? . :i r r.sl- ; v> !*- • v2 . . ^ 

40 ! z, ■• > ?. - "tfii t;V > ..Kty.- C - " T-i; b " ■ "* • ' > ■ ^ • 1 * . • ' 

IPUr Insertion Processing Unit -.ia unit inside the Digital Ad^lnsertiori Module. c " 0 -' ' *- 

Main Stream (MS): The incoming digital stream that carries the normal digital video programming services. 1 - ^ 

Insertion Stream (IS): The digital stream segment that will be inserted into We main stream. "] 

Output Strearrtf(OS): The outgoihg main stream after insertion. . : ^ r, -n^ ■ -v?. 

45 T_in: The externarsignalindtcatirig the desineef starting time of the frisertion in the main streariiy ^ ' :r 

T^out: The :ext^rnal signat indicating the desired ending tihie of -the insertion in the rriain'stream. 4 1 f - v 
spjiin:. Th& kistertion staffing position, or splicing stdrt jfeiht, in the nnain stream * ft is generated i interrially by the '-' r • 
QAIM;:and^is not' necessarily coincident with T_inl ^ ^ '* : -~ ^ ' v . 

spvout?The irtsertittn ending posctionr-or splicin^end point, in the maih streatnh. It is generated inteFnall/by the/ : - 

so DAtM^ahcMt notrfecessarily cothcident with:T^.out. * " • ^ - ^ - r . <. : c 

sp_in ': The starting position of the insertion segment in the insertion stream. ' :i v r * : ' ; ; : l ' "*' J 

sp^outV* "ftieendtng position of the insertion s^ment'in the insertion stream. !t > ; < v "j. "' 

MREGv*v1oviT*g Pidtute Experts Group ^for video; audid and system coding format. '• VlX - ■ • ' f * 

TS: The* MPEG Transport Stream: which' use^ the 188 byte pabket format ± r * r,j 4 ' : ^ 

55 Null Pad<et: A transport packet that does ntf ^ : ; > 7 r ;" • u * 

L: Number of nult packets: r ' * ■ r-.v _ : -r ; i . ■> ■» ■■.-* r - ; - 'f 

PID: The Program IDentifter carried in each MPEG transport packet indi^tihg the "presence 1 of a data stream.' 
PSI: Program Specific Information carried in the transport packet indicating the mapping of a group of PIDs to indi- 
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vidual programs. It includes PAT/PMT.. ^ r. . - *. n 

PES: PacketizecfcElementary Stream is a layer, of data carried by the TS. • -r 

ES: Elementary -Stream - can be video, audio, ordata: ^ — r / ■. y \, ; 

RCR: Program Clock Reference - system clock time stamps which are carried in the main stream. 
5 PGR': Program ,Ciock Reference - system clock time stamps which are carried in the insertion stream.- 

D.TS: Decoding Time Stamps indicating the decoding time of eacl\ES. element in this main stream. 

DTS': Decoding Time Stamps indicating the decoding time of each ES element in the insertion stream: 

R_v: Video bit rate for the main stream. - - r : " ~ : . ■ 

,R_v': Video bit; rate for the insertion stream. . \ >-.-.. 

10 Sequence Header: The highest layer of header in a MPEG video stream. . - ^ . ' 

GOP Header: Grpup of Pictures , header, - the, second, layer of header followed by a complete self-contained 

sequence of pictures (e.g., frames). 

Picture. Header: The header which precedes each picture, , t ; - 

I Picture:Jntra-coded picture that can be decoded without referring to another picture. . • . ■ : 

is P Picture: Forward predicted picture that can be^ecQded using the previous decoded I or :; P picture. 

Anqhor Picture: I or R pictures are anchor pictures since :they may be used as a reference to predict janother picture. 

B Picture:. Bi-directionally predicted picturethat can be decoded using the previous and next J, or P decoded picture. 

Cannot be used as arr anchor picture^ c r .< x . ,~ - «; ;-. r . , r . -,n^r- ^ ^ r , : ; , . 

} vbv_Buffer: Virtual Buffer Vernier (VBV) ;r a conceptual decoder channel bufferthat shall not f overflow or underflow. 
20 t fyj: Transport stream.data rate*.,- ;- rsv? • : .^:--v-.r r r - .. ■>.'•■ — ~ 

( The IPU 400 can process a main transpqrt stream that includes one or more programs (e.g., channels). If the main 
stream carries only a single program, the. IPU inserts the insertion stream into the main stream. Note that the terms 
"insertion stream," "secondary stream," or the^like as used herein can denote replacement (e.g., overwriting) of packets 

25 of the main stream as well as insertion without iossof any main stream packets. However, this latter case will require a 
large amount of memory- f to store the portion pi the main stream which is temporarily suspended while the insertion 
stream is transmitted. Xj) r ; - • ... , , ; . . 

If the main stream carries a plurality of programs, the IPU can insert the packets of the insertion stream into trans- 
port packets in : the main stream that bejong to, one or more selected programs. In this case, the data rate of each ele- 

30 megtgry.dr^m,in i ;ttie insertion streani should.be -the same as the data rate ; of the corresponding programs in the main 
stream. For example, the rate of a video elementary stream in the insertion stream should bjp eqgal to the : rate of the r 
video elementary, main stream whiqh is ? to receive the insertion data : The IPUproqes§es the packets near the beginning 
and end of the insertion so theTesulting stream is M PEG compliant . ... - \ , S, ... !C , 0 , ',. \ ] Y '# L ^. : 

The main stream packet frarner 405 receives : a fully compliant, unaligned JvlPEG-^mairv transport stream at its 

35 channel input, The main stream data is in a serial fcrrmat. The MPEGr2 transport packet synchronization byte may 
occur at any bit position. Jhfy packet fran\er r 4Q5 provides .the transport pac^et^ alignments and outpujts a transport 
stream wh;ch is aligned tathepacket boundary. Reinsertion stream packet framer 410, performs asimilar- function for 
thejnsertion stream. ..->.,,. • - u : , : - :]S K ? - : cS ^-\>.^r '\v . =v : .; 

The Main Stream Parser (MSP) 415 and Insertion Stream Parser (ISP) 420 are used to parse the main stream and 

40 insertion streams, respectively The stream parsers parse the respective aligned streams of the packet framers 405 and 
410 from the transport layer to the picture layer. At a time prior to T_in, the MSP 415 bypasses the main stream in its 
input and send the stream directly to the main stream buffer 480, and the ISP 420 parses the input insertion stream to 
locate the sequence start code. When a packet with a sequence start code is detected in the insertion stream, the ISP 
puts the address of this packet into a register (not shown). The address is a read address for the insertion stream. 

45 As soon as TJn is detected, the MSP parses the main stream to locate the transport packet with the next, or most 
recent previous (if still available), anchor picture start code. When an I or P picture start code is found in the main stream 
transport packets, the MSP 415 sends the transport packet which contains the anchor picture start code (e.g., the last 
packet of the main stream) to the syntax processor 470 for processing. Also at this time, the ISP 420 sends the first 
packet of the insertion stream to the syntax processor 470 to be "fixed" or "repaired", as discussed below in greater 

so detail. When a video buffer verifier (e.g.. MPEG parameter "vbvjbuffer") management is required, the MSP 41 5 and ISP 
420 will also have to parse the PCR, DTS. video rate R_v or R_v\ and other parameters as required, store them in the 
data buffer 485, and provide them to the video buffer manager 425. 

The VBV is a hypothetical decoder which is conceptually connected to the output of an encoder. Coded data is 
placed in the buffer at the constant bit rate that is being used, and is removed according to which data has been in the 

55 buffer for the longest period of time. The bitstream produced by an encoder or editor must not cause the VBV to either 
overflow or underflow. The MSB 415 and ISB 420 output the same transport stream which appeared at the input after 
parsing as discussed. 

At the time T_out, the operation of the MSP and ISP is similar to the Tjn point, except that the main stream and 
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insertion stream are interchanged. That is, after the insertion stream has been inserted into the main stream, the main 
stream must be coupled with the end of the insertion stream. To accomplish this, as soon as T_out is detected, the ISP 
will parse the insertion stream to locate the transport packet with the next,. or most recerrt previous (if still available), 
anchor picture start code. When an I or P picture start code is found in the insertion stream transport packets, the ISP 
5 420 sends the transport packet which contains the anchor picture start code (e:g., the last packet of the insertion 
stream) to the syntax processor 470 for processing. Also at this time, the MSP 41 Spends the first packet of Ihe remain- 
der of the main stream to the syntax processor 470 for processing. In this manner, the transition from the end of the 
insertion stream to the beginning of the remainder of the main stream can be performed seamlessly. 

The video buffer manager 425 checks for the fullness of the video buffer accordmg to its rnputs, PGR, PCR *\ DTS, 
io DTS', and video data rates R_v and R_v\ In caseof a potential buffer overflow, If instructslhe null packet generator 430 
to generate L null packets and insert the packets into the output stream. The number of-packets to generate is stored 
in a register. ['-■ ■? r - * ci 

The syntax processor 470, which can communicate wrth the MSB 480,- DB485 a'hd ISB 490\>f the output buffer 
475, processes the last packet before the splicing point 3nd the first packet after fhe splicing point to provide a seamless 
is transition that is MPEG compliant. At TJn, the syntax processor 470 reads' the last transport packet from the main 
stream and the first packet from the insertion stream. \t checks; the syntax of the packets arid repairs them, if riecessary, 
so that they will be MPEG "compliant, as-will be discussed betov? in greatief detail. At-T_put; the syntax processor 470 
operates in the similar way except that the main stream and insertion stream are ihtercTftanged; TWat is, the syntax proc- 
essor 470 u will read'ftie l&sHraribport packet from theTnsehibn^tfearrf^ahd the 'first jacket frbm ! lhe miain : stream, and 
20 then check the syntax of the packets and repair them, if necessary. Thus, the syntax' jbrbcess6f ! 47CPr'ecelve£ infixed 
packets and addresses for the unfixed packets, and outputs fixed packets. 

In the event of potential butler oveHJdw, the null packet- generator 430 is instructed by the video buffer- manager to 
generate null packets and insert thenrvio the output. TKus'th^ hull packet ^erierafor ^Sd'receives a sighal to generate 1 
null packets, aix^ the number L 61 p3d*ets to generate, "arid outputs nW packets 1 ; * - *. s-: f n: •? 
25 It is desired that the P*Ds or tr>e resulting output stream do not change afte/*he Insertion. Accordingly; a PSI/PID 
replacer 435 is provided to replace the PSI tables and PIDs of the inserted strearft with those of the main stream. The 
PSI/PID replacer 435 receives transport packets with the old PSI/PID, new PSI tables, and a P1D conversion table, and : 
outputs transport packets wit* the PSl/PIO replaced •* ' ov);; * c ' : 

The output buffer 475 ts drvxjed irtto three parts. The Data Buffer (DB) ^SS isDsed to storeHcommon datasuch as' 
30 PSI and nufl packets. The Mam -Stream -Buffer^MSB) 480 ancttnserfion Stream Buffer 0SB}- 49Cj% e'used to%tqre" ; A Jie f - 
mainsfr^m'fend'lhsertidn stream; respeinrveTy:- *~ *i- J ■ 1 . ~ "* " i3 v c : '° ° Cij -^: ff ^ "O-i ipso- 
' A buffer controller 4d5*sused to co^r^^the^ad^hd wife operafions of th£DB; : IvTSB/and ISB. also performs 
addressing and output scheduling of each transport palcket ^or^fi the MSB, ISB and D&. ° ;0 1 V; 1 
A group of -regi§tens (riot shown) used iri"th6 s^em'tor stb?irig^ various parameter^ such as* packet addresses 
35 and N, the number of null packets. A mapf of registers wfiibh may be used in accordance with the present invention 5 is" : 
given in Tabtel ,%elow. ft shdukj be apfxeoatteil that Tabled is ah example only, and any other suitable rhaf> could be 
used. In T^leh, the first colu^ coluhrfn indicafes^tHe riurnbfer otbitsVthethird^ 

column indicates whether read (R) and/or write (W) capability is required, and the fourth column describes^the function 
of the registerloc&Tioh. 1 r ^'^b 0 < ■. '.-'r^-^ : "' ! ' ? : ■ ! - - r 

l. -...v •> . • .. ! --, ::. •:^Vtr , --n;;- : :^. :\ y&.v .-is * . V '.^< . : '•■ 
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Table 1: 



5 


Index" ■ 


Bits: 


R/VV 


Description ~ , . 




r 


7:0 


R,W 


Read address for main stream 




2 


7:0 


R,W 


Read address for main stream * 1 




3 


7:0 


R,W 


Read address for main stream 


10 


4. 


'7:0 


R,W 


Read address for main stream 




5 


7:0 


R,W 


Write address for main stream 




6 " 


7:0 


R,W 


Write address for main stream 




7, ~ 


7:0 


R,W 


Write -address for main stream 


15 


8 


7:0 


R,W 


Write address for main stream 




9 


7:6 


R,W 


Read: address for insertion stream 




10 


7:0 


R,W 


Read address for insertion stream'' 




11 


7:0 


R,W 


Read address for insertion stream 1 


20 


12 


7:0 


R.W~ 


Read address for insertion stream ■'-:'"> 




13 


7:0 


KWi 


Write.-address for insertion stream 




14 


7:0 


R,W ; 


Write address for insertion stream i * ' ' 




15 


7:6 


R,W; 


Writeraddressforinsertion. stream -t 


25 


16 


7:0 


R,W 


Write address for insertion stream i 




17 


7:6" " 


R,W 


PGR of current stream 




18 


7?0 


R,W 


PCR of current stream ! ; " ! ' ■ ' 




19 " 


7:0 


R,W 


PCR of current stream •. T ! 


30 


26 


7:0* 


R,W 


PCR of current stream : > : V ! 




2i~ 


7:0 


R,W 


PCR of current stream 




22 " " 


7:0 


R,W 


PCR of current stream \ a - t } '„"i o \ i 




23 ' ~ 


7:6 


R,W 


DTS ofjsurrent stream -v 1 • : j 


35 


24 


7:0" " 


R,W 


DTS of current streafcs ~~- • 




25 


7:0 


R,W 


DTS of currentistream - ■ <\ . ^-v ! 




26 


7 y 0 ™ 


R,W 


DTS of current stream >.< " I VV i 




27 


770" 


R,W 


DTS.of current stream " ]'■'• 7/ , , 


40 


28 


7:0 " 


R,W 


Address for PAT tf v 




29 


7:6 


R,W 


Address for PAT s v . * 




30 


7:6 


R,W 


Address for PATs 4 : C 




31 ' 


'7:6 


R,W 


Address-forJPAT i .: • ; 


45 


32 


7:0 


R,W 


Size of PAT in number bf packets' 




33 


7 ;0 - 


R,W 


Address for PMT , ' 




34 ' 


7:0*7 m 


E,W-r- 


Address for PMT-! . * ' ■ 




35 " 


7:0 ". 


:&W 


Address for. PMT ; •■•■>.-• » . . 


SO 


36 


7To >t * 




Address for PMT ... • 5 
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37 


7:0 


R,W 


Size of PMT-in number of packets 


38 






Interrupt register. 

= r n. p"*-^ — , -y - - — - 




7 


R 


SS, Splicing signal 1: SS'is detected; 0; splicing .. 
processing done * * * . : * . . ' . 




6 


R 


MSD, l:;Main streW done i V 




5 


R 


ISD, 1: Insertion stream done / \\ ... 


► 


'4 


R 


NPD, 1: Null packets done" _ : . 




3 


R 


APF, 1: Anchor picture found 2 




2:0 


N/A 


■Reserved . ~ ... 'J ; 


39 


7:0 


R.W 


Number of Null packets to generate y„- 


40 


7:0 


R,W 


"Stream output read, address ,: - \ 


41 


7:0 


R,W 


Stream output read address ; . v r 


42 


7:0 


R.W 


Stream output read address- i /. *} \ j . 


43 


7:0 


R,W. ,c 


Stream output read address- r - 4 ; _ .* 


44 


7:0 


R,W: 


Main video elemental^ /stream _ratfe> L.-l *i..,„. j 


45 


7:0 


R.W.-S 


. Mainivideo elementary stream rate ^ j _ ' 7 . .*. 


46 


7:0 


R,W 


Main video elementary toearii rate - 


47 


7:0 


R,W 


Insertion video; element afy stream rate 


48 


7:0 


R,W 


Insertion video fcleinentary stream rate 


49 


7:0 


R,W 


Insertion video '-elementary stream rate 


50 


7:0 


R W 


PID1 of main stream : 


51 


7:3 


R,W 


PID1 of main streaotf » ■ 


51 


7:0 


R,W 


PDD2 of main stream) \ J.-1-1J. . - 


52 


7:3 


R,W 


PDD2 ofmaintstream }J Lb J: J v \ 


53 


7:0 


R,W 


PID3 of main stream '"L _ - ; *. - ~ 


54' 


7:3 


R.W 


PID3 of main stream-^ ^ i *' .. : A. 


55. 


7:0 


R.W 


PED4 of main stream ^ * > j 1 ... - ; - 


56 


7:3 


R,W 


PBD4 of mafastreaafci- • „ :C 


57 


7:0 


R,W 


PID 1 of insertion stream V ! - ■ v - ' ~ 


58? 


7:3 


R.W 


PID1 ofinsertion streain T 7 ! : ..- ~ ^ 


59. 


7:0 


R,W 


PED2 of insertion stream [ L : 


60 


7:3 


R,W 


PID2 ofinsertion stream: : 'l .u ' 


61 


7:0 


R,W 


PID3 of insertion stream - „ 


62' 


7:3 


R,W 


PID3 ofinsertion stream ± 


63 


7:0 


R.W 


\PJD4 of insertion M"eam iLL-J*;.: . 


64 


7:3 


R,W 


PBD4 of insertion sfareaifib' . . ; 


65«-68 


7:0 


R.W 


Read address for PBD1 cff insertion streartr 


69 r 72 


7:0 


R,W 


Write addresk for PBD1 ctf insertion §treani „\„ 


73-76 


7:0 


R,W 


Read addres^ for PID2 ^msertion^saream J 
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77-80 


7:0 


R,W 


Write address for PID2 of insertion stream 


81-84 


7:0 


R,W 


Read address for PID3 of insertion stream 


85-88 


7:0 


R,W 


Write address for PID3 of insertion stream 


89-92 


7:0 


R,W 


Read address for PID4 of insertion stream _ 


93-96 


7:0 


KW 


Write address for PID4 of insertion stream 



25 



30 



35 



40 



45 
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The complexity of the IPU largely. depends on. the video buffer management scheme. Two implementations of a 
video buffer management scheme in accordance with the present invention are presented! First, in a simplified version, 
the number L of Jiuli packets for padding the^output stream to prevent buffer overflow are provided only according to the 
video elementary stream data. rates r pf the main and insertion stream, R_v and R_v', respectively. At TJn, the number 
of packets to pad with null data is'.corrputed.'as:.-.,.. , . .. . 

L = vbv_buffer_size ' ( 1/R_v- 1/R_v*) vR^t /^(J88*j3). _ ' " . ^ 

At T_out/tr|e number'of p^^ , : ' ' ; . * t ( .. 1 . 

„" ^= >*v_buffe> v siz£ ^ ^ '" ; ' ^V"^ , T \\ y% 

^®^ v ^^?^; o y^ i ? ^S^fVS therejs.no need to track th^.ROR and DTS of the 

stream, the disgdyant^ges are thafpa^'^ than needed, and decoding or display discontinuities may result. 

Note that padding is required c^wnen has a higher data rate.than the main stream, 

In a second, rxmB^fg)^^B^fr$f^ of the video t5uff*er c ,npanagement scheme, padding is used according to a 
decoding delay, of/thie main and motion' strea^ and the jvijdeo elementary stream, rates. The decoding delay is the dif- 
ference .^etween . the time^mejast bytept a picture is received and the time when decoding „is completed. With this 
scheme, at t_in,^e hum *" 1 

L = (de<^irialbelay - vbv_bu«ef_stze/R_vO * R_j / (188*8). 
At T_out the nuni^r of pac^ts to pad ( is cpmpuiedas: ■ - f L- . ' . 

deq twl ... _ o ( a j ,,_ w% ^ w 

therefore the P&R and' DTS of the data stream must be retrieved and decoded. This requires additional h^w^and ■ 

expense. ..- ~- • . „ E ., . f ~''- !,t ' : - ^ ■°- jt ' 

With either of the above schemes, the cajculatiqn of the 'number of null padding packets catj be coriputed using pe, 
following definitions and assumptions. " * ~" : ' ^ ~ 1 J: ' l \ . r ' 




Definitions:. 



.no-* 



B0:. Video decoding buffer size^t the eind pf ojd ptrearn! 
vbyjbuffej_s ; ^ ^ 
Tjpad: Duration of nulf p^ingbits.?' r !'. 



At T_in pointy 

.Bp -flVtXpad + (R^y A 
R_v)*(dec6dingjdelay-T_pad) " 
^\^v_buffer_size;jand -^t 

T^ad ^decoding^ . 
(vbvjbuffer^siz^ _ , J: ' 

Since B0 = de<^ingJ^de!ay*Blvi we have: ' , 

T_pad ^decoding-delay - vbv_buffer_size/R_v'. -< " U " 

Since dfcpding_dQlay < vbv^bMffe^R.y,, tp simplify the computation,. T_pad can be written^ as:', . V 

For example,, ijf R^f Mbps.and R_v:=8.lvibps! then the padding "time will be: f ' " ' 

. ij3ad= ^5008^(1^ t '!.';: : /- ; , _ 

.However, this does not mean thatthe.^ seqond. In fact, there will be noyis-' 

ible discontiriuity when fte.datajs displayed br^a television ^reen^ippe the 0.23 second dielay only fiushesbut part of \ 
the data in the,videb de<x>dir\g buffer Aft^0.23.se5ond, tfie'd^ta^rbrri the msertipn !i^cesun. will f ni iha buffer whil%'f^e ' 
decoder is still decoding the data from the main stream. As long as the time to. decode .the remaning data in the video 
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decoding buffer is greater or equal to 

(vbv_delay_of_first_picture -Jfcicture_7ate) of thelnsertion stream, there will be no decoding discontinuity."" ' 
Furthermore, at T__out, T_pad is cbmputedas: ~ — . ; ; - 

T^pad > decoding_delay -\^3uffensize/RJ^v;"'- - ' : } -* *■ ; . : . " ~" ' : ~ Y" 
s or simplified to:' 1 _ 1 : -:„: ' ' *•■._": .*.'.'. - - 

T_pad> vbv_buffer_size*{1/R_v' r 1^v).o r- . - :i ^ - > ' . ; , '■*:_ . 

The number of padding packets, N, can therefore be computed as:' ." ; ( " *, 

L = T_pad*R_t/{188"8). - ' . ~ - • 

FIGURE 5 illustrates the processing flow of the Insertion Processing Unit of FIGURE 4 in accordance with tee 
io present invention. Note that the steps of FIGURE 5 are shown as occurring in a sequential manner for clarity, but many 
of the steps may occur concurrently and/or sequentially. At block 502, the IPU outputs the main transport stream from 
the main stream buffer (MSB). 480' ? the IPU is essentially jn a bypass : mode at this time-since the insertion stream has 
not yet been inserted. At block 506\ the main stream parser parses the main stream to locate the splicing signal TJn. 
Note that TJn need not be cdrried in the main stream, but may be provided locally, for example, at a cable system head- ; 
75 end. When TJn is detected , x the IPU continues to output themain transport stream from the'main stream buffer. At block 
508, the main stream parser parses the main stream to locate the closest packeiSwith an ahbhor picture (e g , J or P 
picture) start code and passes that packet to the syntax processor 470. This packet will be the last packet of the main 
stream. To ensure that the resulting data stream is MPEG compliant, n6 &kta trpm'tWe ^next frafme or sequence of frames 
may be included in this last main stream packet. At block 512, the syhta* processor adds a sequence end code field to^ 
20 the last packierof the matn stream, the sequence" end code* is J *a 'tweh^-fblir b'^cod& Vvhich indicates the' fend df a J 
sequence of pictures. At block 514,*the PSI/PID replace* 435 starts ^replace the PSI/PID bf the insertibh'stream. 

At block 516, trfe syntax processor processes the firsf packet of the insertion stream (e.g., the packet which cbn- " 
tains the sequence 'stert cbde) so' that any data before : the r science start codelVi this packet that is coming from the 
insertion stream'is : replaced with stuffing bytes in the adaptation field. If the r adaptatioh field does not exisiV it' is created.* 
25 The packet's transport header and PES header are also modified; to ensure that the output stream'is MPE& compliant; 
The syntax processor also sets the discontinuity indicators of the insertion strfearh in ISB for all the packets before' the 
PCR packet to "1\ v< \ / ; r : 

At block 518. the video buffer manager 425 calculates the number, N, of null piackets to' pad. At block 520, at the 
end of the main stream, which is designated as the position' sp_in, an interrupt signal, Main Stre^fri Donie (MSD),, is gen- 
30 e rated. At block 522, Sffer receiving' the MSD signal, 'the IPU reads the null packets fromtheidata bu^er^iS^ 
the null packihs to'the outiijt stream. Arblbck 524, at the end of the null jtectfetsr; 

(NPb)vfe^^ted^^^ - ^ ! ^ : * : * i;r v " r? * a "' c - 3 ' f 

At block 526, after receiving the NPD signal, the system begins to output data from the insertion stream buffer 490 
at a fios'itidn wnich r is designated : sp_in\ At'lfte sarrte'time. the' MSP reads' frdm the'maih stream and puts^a new 
35 sequence in the MSB. 

At block 530, when T_out is detected, the processing continues at block 540. Otherwise, the system is in a waiting 
mode until T_out is received. At this time, the system continues to output data from the ISB. Generally, T_out may be 3 
provided locally, for example, by a cable system headend. However, rt may be preferable for TJn and J_out to be pro- 
vided in the main stream so that the cable headend is not tasked with rrian^gfRg th£ tffne anS I d&atiorTof the insertion. 

40 Moreover, the gap in the main stream in which the insertion stream is to be provided will ndt typically be cbntrollabie by 
the cable headend. At block 540, the ISP parses the insertion stream for the packet with anchor picture start code 
and passes that packet to the syntax processor. This will be the last packet of the insertion stream. The syntax proces : . 
sor processes this last packet of the insertion stream so that there is no data from the next frame or sequence;pf frames 
included in the packet. Thus, the resulting data stream will be MPEG compliant. At block 544. the syntax processor 

45 adds a sequence end code field to the last packet of the insertion stream. 

At block 546, the syntax processor processes the first packet of the main §tream (which contains the'-sequ^nce 
start code) so that any data before the sequence start code in this packet that is^c6ming frorrrVnaih .strearfi is replaced 
with zeros. The packet's transport header and PES header are also modified to ensure that the outpu^strearms MPEG 
compliant. The syntax processor also sets the discontinuity indicators of the main sSred!rn in the v MSiB for all th ! e packets 

so before the PCR packet to "1". , / " H C V . " v "\ "T. ? " I*,.* 

At block 548. the video buffer manager Calculates 'th^liurnBer oTnuif bkck&fe to piti. At Wdck' 55Q, at the fend 6f IS. 
which is designated sp_out'. an interrupt signal. Insertion Stream Done (\SO)?\$ generated/ At block 552, after receiv- 
ing the ISD signal, the system reads the null packets from the data buffer and wrftei tb the output stream. At block 554/ 
at the end of the null packets, an interrupt signal.. Null Packets Done (NPD)?fe;generated/At^ ^ block 556. after receiving 

55 the NPD signal, the System begins u> read frbrri the MSBT^f a point whVbrrte designated sp_out. TKCis, at this' time, the 
insertion strearrf ends and the next portion of the main stream begins to be du^ut. Af the sa/ne time, the ISP reads frorn 
the insertion stream' and puts a 5 hew sequence in the ISB for ixMre us6* 7 The process continues at blod^ 506' where tte; 
MSP parses the rnain stream for the neoct splicing signal, Tjri. " " *' ! ' ' ' ' t y " - i 
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In practice, the invention is particularly suitable for inserting commercial messages into one or more network tele- 
vision programs, For example, often times, a network program is transmitted via satellite to local cable system operators. 
The cable system operator has the task of inserting commercials from local businesses into the main stream. In this 
case, it may be desirable to provide commercials,, for example, every twenty minutes. Furthermore, assume one com- 
mercial is inserted, and that the commercial has;a duration of one, minute. Then, for a network program which runs from 
8:00. p.m. to 9:00 p.m., we may have T_in=8:00 p.m.. T^out=8:01 p.m., then TJn=8:20 p.m., T_out=8:21 ,pm, and 
finally TJn^8:59 p.m., T_out=9:00 p.m. Other variations are possible, of course. Ffor examples prerecorded series of 
commercials may be assembled. In this case, the beginning of the first commercial will correspond to TJn- and the end 
of the last commercial may correspond to T_out. Alternatively, the network program may include one or more commer- 
cials already in the main transport,stream. In. this case, the present invention may be used to.replace selected ones of 
the main stream commercials, or to remove selected ones of the commercials' without replacement. Note that the latter 
case may not be possible in real-time. „' , 

In order to implement the processingflow oif FIGURE 5,' the structure of a packetized data stream must be exam- 
ined in.greater detail. In a packetized digital data stream, typically the.packets carrying the compressed video data will 
be multiplexed with other packets, e.g., carrying corresponding audio data and control information necessary to recon- 
struct a television signal. One standard for transporting digital television signals in this manner is the MPEG-2 standard, 
details of which can found in document AVC-491, version .1,, April, 1993, published by the Telecommunications Stand- 
ardization Sector, Study : Grqup 7 1 5, Experts Group 4ATM r Vjdeo Coding of.the Internatipnal Organization^ Standardi- 
zation, ISQ-IEC/JTC^ l^ntitled "Coded Representation of- Picture and Audio, Information," incorporated - 
herein by reference; IS0/IEC 5 1381^^ and Associated 
Audio;: incorporated herein by reference; and JSOyiEC 13818-1, April 27, 1995. entitled "Coding of Audio ; Picture, Mul- 
timedia and Hypermedia : lnformation," : incorporated herein by. reference. Further details of the video syntax and seman- 
tics for MPEG-2 video can be found in International Organization for Standardization document ISO/lEC, 11 1 72-6 dated 
April 2. 1993-and entitled ^Revised Syntax and Semantics for MPEG-2 Video." also ; incorporated h.erein by reference: 
Also of interest,, and incorporated herein by reference, ^document MC68VDP/D, ^ preliminary data sheet entitled 
"MPEG-2/DCII Video Decompression Processor," ©Motorola Microprocessor and. Memory Technologies Group. 1994 
which describes a video decompression processor using the MPEG-2 and DigiCipher®! I standards, i 

In the MPEG r 2 system (and, the similar, DigiCipher® II system proprietary t<? General Instrument Corporation, the 
assignee ^hereoO^fran^rt stream, ©^transport multiplex is made up of a contiguous set of fixed length packets. Each - 
P ac Kfy§ : '1^^M^?j in Jepgtfe.wjth the ; first four of those bytes being defined as the packet header. .The payload 
portior^of^ 3 ^ 

the header, v/hen required. VV/ien,an adaptation afield is present,: the payload portior^of tbe-Ocicket will be correspond- 
ingly shorter. ~ ■ ...... ^ , ... : 



Various timing and identification information; is pfoyided in different portions of the transport stream. These include^ 
a packet identifier ; (PID) found in the transport header oi each trar^sport padset to- provide a reference numberrfor iden- 
tifying the t transpqrt packets carrying^ specific seivice cprrpOT^ include^ in a service definition or 
"service map" used by the receiver to identify those transport packets required to reconstruct a television program sig- 
nal. The Pip may also be -referenced for various grooming and remultiplexing functions, In the case of video, audio or 
isochronous control data 0 the stream of packets ^labeled with a single PID represents a sing!e i video.- audio or iso- 
chronous data service elementary.sfream, respectively. Each type of packet will have a different PID identifying the, 
packet type. ? . , : . , r . ,,. 5 . r£>; . r . :; . c 7 // ". ./ * :; , 
Timing information carried[£y the transport stream includes a program clock reference (PCR) which effectively rep- 
resents a sample of the.system time clock (STC) timebase.that underlies the service cpmposed of the PIDs referenced 
in the. service map. The PID carrying the iP acket with the, PGR is a|so referenced m ,the service map. The video, audio- 
and isochronous data .components^ a service are-locked through; adef ined relationship to the.system time glock. Thes 
PCR serves to def ine the transport rate,, in the sense that between any two successivePCRs in one PID, the transport 
rate is constant and nominally equal to the system time clock rate times the ratio of the total .number of transport bytes -\ 
betweeathe^ , fv . , . ^ : \ 

The timing information . carried -by the transport stream.also includes time stampsjfor the commencements decod- * 
mg and .presentation f of,data,for display. The presentation time stamp (F|TS) is.usedfo^service component acquisitions . 
and a|so.for evaluating whether,timing,and buffer cqntrol are operating properly atthe decoder. The decoder time ; stamp lt 
(DTS) js.used-lo irxJicatQ when th.e>lecod.ei; should start to decode thefirst access unit (e:g^videaframe)-that starts irj ■ ; 
the payload qf.a packetized elementary.stream.(P.ES) .packet whps.e header includes the: DTS, A packetized elementary,, 
stream is a data stream composed of end-tq : end PES.packets.whicfchave variable length and are typically far longer 
thana fixed length transportpacket Thus, a PES packet is typical^ composed of data from a plurality of transport pack= 
ets. - . 



FIGURES 6a to 6c are diagrammatic illustrations showing how .variable length PES.packets are reorganized, into 
fixed jength transportnoackets 7 fpr use in providing a transport muftiplexfor transmission: FIGURE 6a illustrates.a portion- 
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of a packetized elementary stream carrying successive PES packets, each having a header (PES-HDR) 672 and a PES 
payload 674. The PES packets 670 are of variable length. PES packets are typically several thousand bytes in length: 
They are required to be aligned in such a mariner that, when divided into transport packet payloacJs, the first byte of 
every PES header is located in the first payload position of some transport packet. For any transporfpacket carrying 
the aligned PES header, a "payload unit start indicator" will be set in the transport header for the transport packet. In 
the MPEG-2 ,and DigiCipher® Hsystems, the PES format is used for allservice components that are inherently syn- 
chronous. More particularly, video, audio and isochronous data components are carried as" packetized" elementary 
streams; and the PES headers 672 will carry various information necessary to diefine the payloadi including a packet ; 
start code prefix, a stream identification, and a PES packet 1 length. v " - ' 1 ' 

The header may also contain a presentation fee stamp) (PTS) or dfecode time sfemp (DTS). The PTS is a f teld ' ' 
which indicates the value that corresponding bytes of the decoder 'system time Clock 1 reference should have when the 
first presentation unit (i.e.. video frame, audio sync frame, isochronous data access\inrt) whose access unit starts 
somewhere in the payload of this PES packet is presented^ For Video; r an access unit starts 8 the first byte of the picture 
start code is present in the payload of the PES packet. For audio, an access unit starts' if the first byte of the sync word - 
75 is present in the payload of this PES packet. For isochronous data; an access -unit starts if the first byte of the data 
header is present in the payload of this PES packet. The PTS fieldfe usedTor service component acquisition, and also ' 
for evaluating whether timing and buffer oontrol are^ operating ^ : r ; 

The DTS is afield indicating what value corresponding bits of 1he~£ecod'ef-system tin^ dod^Vderence should have [ 
when the decoder starts 'to : decbde ; the f irsf access unit that starts s&mewhere in tne^payload^of this PE-S pabket. The 
20 PTS and DTS differ only ffcr video, and onl>hh the ea^ ' \ 

The PES payload contains the information data that' is desired tb~be transmitted td^Ve&efo 
includes all of the video, audio and control infopmatiori necessary for ihe receiver to decode and recbhstruct; e.g.. a dig- °" t: 
ital television signal ^ ^*- ! ;; • ' v'-W. :i; / s . 2 * - I m t:r. .-.y,^'.^ s- 

In order to meet the requirements' of robustness arid simplicity a fix&- packet length approaches preferred to the 
25 variable length PES packetSf Thus, £s illustrated "in FIGURE 6b, frie packet demenfary streahS corrtaining-thfe PES 
packets 670 is reconfigured into a stream of fixed length transport packets 680^The tranSpibrt packets illustrated in FIG- 
URE 6b all correspond to the same service cdmpbnent. Such as the video component df a digital television transmit ; 
sion. In the MPEG-2 and DigiCipher® II embodiments, each packet is 188 totalbytes in length, with the'-first four bytes 
comprising a transport packet header (TP HDR) 632. The payload-portion 684 of each packef680 is mus;norrnally 184 ^ 
30 bytes. However, an adaptation field mechanism is present as illustrated by transported^ 6^~? ^exfei^i^^^ 
when required; The adaptation fi6id 686 provide^radditiohal information whfchisndtr^ufrea 

The adafctf&tibri field ( ; ADPPFIEL0)B86^^xfehdsth^regulaf tf&ispoft headef 682 at thg^ense^ payload 684, r which € * 
will be less than 184 bytes whenever the adaptation is provided. The adaptation field 686 is of variable length, depend- ■ f -^ t 
ing on the information it cbritaihsrTypfcalfy, thefedaptationlield wll&uppori adcfiliorial information for time base recovery 

35 and other functions; and also provides a nfechahferri for pfatfiSingthe^y^ * 
Such padding Gan teifsed. fer example. ^ m^ffa'van^Ferate vided packetizted elemehtoystream into 1 a cbnstent ■ ' ; 
rate transport strteani;'-':- -ro'^ch-. :izj'i^o*ci:^-- »!c£;.i:\' n< bi oi vrv*c*- sr. ^o:.^; 

As indicated in FtGURE- 6b, theftf&rtfej?>bVt header oreachtran^ortpad^efinctudes the PlD which jdentrfies the par- 
ticular service component carried by the transport packet. The PCRwilf be earned by atfadaptation-ffeld to^rbvtde tim- 

40 ing information for* a desired-service At a receivfe^- th& PGR for the desfred Serviced detected from the adaptation field: 
The PIDs of the transport packets will then be monitored in accordance with the timing established by the PGR to 
recover those transport packets carrying a particular cofhponent of the service to be processed. 

Transport packets front VarfouS'sfervice ^dm#driehts are multiplexed fnto a ttensfxbrt nfniWplex 690 as illustrated in 
FIGURE 6c.*The transport Multiplex will tarry interspersed pSekits from each of 'the^ifferent components (e.g., video, ^' 

45 audio and control) necessary lib 'reconstruct a service at the receiver. In the illustrative transport multiplex shown in FIG- ' '/ ; 
URE 6c>videb transport packete OTa (Ar r rA 2 . A^..) ai%i6IIowedby audicfbompohents 692 (B^B^, B3...) which, in tdm. 
are followed by controrcomporient pacl<et§ &&4?{G V C 2 , C 3 :..): n: ' - r ' - 1 * 1 ' ' / 

With the foregoing in mind, the 1 bpe'ration^of the isyntax ;r processor 470 of the IPU 40O in fixing- the packed of the '* J 
main Stream or the in'sertioa^ wh'efein 

so the test packet of the main or" insertidnstream, respectively, before'the splicing-pdint, is fbroressedtd maintain cbmpli--- ' 
ance with'an MPEG^or similar ©ommunicatibn protocbl. the splicing p'oiVifls We bouhdary"between the main and inser-; ;^ 
tion ^treaiti packets: This Gor^espdnds tdthe point between spjn of the rtiafn stream anld ^>_in' 61 ihe insertion Stream 1 ! • 
when the output 'stream tratHsitiSns 1 from the-matn to the insertion stream, or to the poihtfc'etween spiout' of the' insertiOfi 
stream and sp_outbf themaln strearfi^wrt'ehthe oufcfut dtrtearh itarisitibns from thie'fnfeertioh id the main stream. 

55 Genej-aliy; the 'last packet of th6 data stream bfeforei'th^- splicing poinVhas to ^6 processed : sihce the : franspoft ;1 r 
packet boundary may not be the same as the picture boundary. This last packet will be referred to as apre-splicing d_ate 
packetC'in this case, the pre-splifcinjg piac^et will cohtain'partof the datWromPthe next r (aYt<^6rVframe?T^ 
packet can bef ixed by discarding : thef data from the riext ! frame and stuffing (he same^amouht'of bytes to the adaptation - 
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field of the last packet, where it is understood. that stuffing bytes are simply dummy bytes of data. If an.adaptation field 
does not exist in the last packet, it can bf created. Note that afterf ixing the information contained in the adaptationj ield 
and pes_hdr, including adaptationjieldjength, payload_unit_start_indicator, pes>length, and other parameters, may 
be changed. However, this is not expected to result in any visible discontinuity or artifacts to the viewer, when the data 
5 is displayed. ... . ... * v ., ..... 

Processing of the pre-splicingpacket is treated differently depending on whether the packet has an adaptation field 
and a PES header, $ncj further depending on the location.of data fields in the packet. FIGURES 7a-7d show a pre-splic- 
ing data packet having an adaptation field and PES header before and after processing in accordance with the present 
invention.^, :-'*■,•:■'_::>-■' v--; * ., < 0 , 

10 In FIGURE 7a, thepacket, shown generally before processing at 700, includes a transport header 701 , an adapta- 
tion fiefd- 702 carrying^ bytes, a first data field 703,-a PES header (pesjidrj 704, a second data field 705, c a picture 
start code 706 carrying four bytes, and a third data field 707 carrying M bytes. In this case, it can be seen that there is 
data carried in the packet 700 between the adaptation_f[eId 702,and;tfte. pes_hdr 704r and between the pes^hdr 704 
and the pic_start_code 706. ; rr ■ ' :: - - - !vri 

15 Moreover, since the pic_start_code 706 def ines the start of a new picture pr frame, it can be seen that the third data . 

field 707 carries data of the new frame. Thus, in accordance with the present invention, the packet 700 is processed by 
discarding the data of the pjc_ L start_code 706 and,the n associated third data field 707, and stuffing 4+M dummy bytes in 
the adaptation field 702.= This results; in-the processed packet 710 which include^ the adaptation field 712* and. which 
terminates with the second data field 705. The packet 71 0 includes data from only one picture and does not require dthe 

20 next adjacent packet to maintain : continuityr r : ,k £0r v . r ^ - - >' v o . 

. Note ,:that -in FIGURES 7-11 ; ^the ; relative width* of ?a, packet or a field thereof does not necessarily indicate the" 
amount of data carried [in the field -or the packet. < \ , 

ln.FIGURE^7b,rthe unprocessed packet is shown generally at 720, and the processed ipacket is shown generally at 
730. Here, there is databetween the adaptation^ ield 702 and the pesjidr 704, but not between the pes__hdr 704 and 

25 the pic_start^code 706. In accordance with the present invention, the packet 720 is processed by discarding the data 
of the pes_hdr 704. pi c^start_code 706 and the third data field 707, ^nd stuffing N+4+M dummy bytes in the adaptation; 
field 702.. This results jn the processed packet 730 which includes the adaptation field 732; and which terminates with 
the first data field 703 K *><,;,' v . .,i - 

In FIGURE lo, theunprocessed packet is shown generally at 740, and the processed packet is shown generally at 

30 750,^9,^^45^^- b t etwe^n : tr)apes^hdr 704 and the pic,start_code 706, but not between the. adaptationj ield 702 
and the pesJidr7Q4 0 ina^ the present inyentipn, the packet 740 is processed by: discarding the data.of 

the pic^start_ccde 706 and the third datafield 707, end stuffing 44,M durnmy. bytes in th^iadaptation field 702^This^r 
results in the processed packet 750 which includes; the adaptation field 752, arvd which , terminates jwith the second date 
field 705. ' " r . v , u , y . 

35 in FIGURE. 7d. the unprocessed pa<^eti^owngenjBrjallyat 76Q. Hers.there isno data field between the pes^hdr - 
704 and the pic_start_code 706. or between th^^daptartiorrrf ield 7QZ and the pes Jxlfr 70,4.: In, accordance with the 
present invention, §s shown at : 7*70, the entire paekgt:760 is nc^transmitted since there would be; no. data fields remain- 
ing aftendjscardingfthe third data>f ie!d 707. r f iiVcer / ^ ; ror ^vVi.e^q, vi. ; — > - v. . 
FIGURES 8aand 8b show a pre-splicjng data packet having an adaptation field but notPES header before and after. 

40 processing in accordance with the,preseni invention. In FIGURE^ 8a, .fre unprocessed packet is shown generally at 800, J 
and the prpcessed packetiis shown.generally at 810. Hene, there Is date between tire adaptation field 802 and the 
pic_start_code 804. In accordance with the present invention, tfie packet 800 is processed by'discarding the data of the 
pic_start_code 804 and the second data field 805, and stuff ing~4+M dummy bytes in r the adaptation field 802: This 
results jn the processed packet 810 which includes the, adaptation field 812, and which terminates with the first data- 

45 field 803. rr v . r v , . . v . r , v ^ x , 4 - ^, . ; . fi . . . t; . 

IrvjflGLiRE^b; the unprocessed packet is shown generally, at 820. Here, there ismo data. field between the adap- 
tation field SQ2> and the pic„start„<;ode^804. Irv, accordance, with *e present invention, as shown at 830, the entire ,: 
packet 820 is not transmitted since there would be no data fields remaining after discarding the;second t data field 805;^ 
< F|GURES.9 ( a-?C':Shp\y s^pre-sp! icing datapacket having no adaptation field but with a PESiheader before and after 
so processing in ^cco^c-ance with Jhe^ presen^jnyention. In this case, an adaptation field is created which carriesJhe * 
dummy-stuffing bitswhich account fpr r the discarded fields. In FIGURE 9a 4t the packet, shown generally before process- 
ing at90D. includes a.transport header, 901 , aflrst data ; field 902, a PES tJ header 9Q3, a second data field 1 9Q4, ; a picture ; r 
start code 905 carrying four bytes and a third data field 906 carrying M bytes, in this case, data is carried.between the 
tp_hdr 90.1 and the pes^hdr^goSi and^tw^en.thepes^ 903 andlhe pic^start^code 905. In accordance: with; the 
55 present inventipji tfie packet 900 is processed by. discarding the data of th€s pic^starjt^code 905 and the third data field < 
906, and creatingan jadaptatjpniield 91 2 with 4+M dummy fcytes as shown in the processed packet 910. ^ i . r 

Jn FIGURE 9b,-Jhe unprocessed packet is sho?wn generally at 92Q, and theprocessed packet is^shown generally at 
930. Here, there is data between the tp_hdr 901 and the p,es_hdr,$03,' but. not between the pes„hdr 903 and ; ,the 
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pic_start_code 905- In accordance with the present invention, the packet 920 is processed by discarding the data of the 
pes_hdr 903, pic_start_code 905, and the third data field 906, ! -and creating an adaptation field 932 with N+4+M dummy- 
bytes, as shown in the processed packet 930. ; ' -* - ■ i: *•" •' 

In FIGURE 9c, the unprocessed packet is showngerierally at 940| and the processed packet is shown generally at 

5 950. Here, there is data between the pes_hdr 903 and the pic_start_code 905. but not between the tp_hdr 901 and the 
pes_hdr 903. In: accordance with the present invention* 'the packet 940 is processedrby discarding the data of the 
pic_start^code 905 and the third data field 906, and creating an adaptation tield 952 with : 4+M dummy bytes, as shown 
in the processed packet 950: * ** V ' v - 1 * * • - ' ' " - 1 : 1 v 

In FIGURE 9d, the unprocessed packet is shown generally at 960. Here, there is no data field between the tp_hdr 

w 901 and the pe r s_hdr 903, or between the pesjidr 903 and the pic_startJcode 905. In accordance with the present 
invention, as shown at 970, the entire packet 960 is not transmitted since there wotold-be no data fields remaining after 
discarding the third data field 906. - 1 — ■ " * . 

FIGURES 10a and 10b show a pre-splicing datapacket having rid adaptation field or PESheader before and after 
processing in accordance with the present invention. In this case, an adaptation field is created which carries the 

is dummy stuffing bits which account for the discarded fields: In FIGURE 10a, the-unprdcessed packet is shown generally 
at 1000; and the processed packet is shown ^generally at 1010. Hfere, there is data between the tp_hdr 1001 and the 
pic_start_code 1003. In accordance with the" present invention, the packet 10d(> is processed by discarding the data of 
the pic_ start_code 1003'arid the seddnd data field 1004, andcreatihg*an adaptation^ field 1012 with 4+M dummy bytes, 
as shown in the processed packet 101 0.< * % ^ub'^Oi'^vi^v.i; ^ v'T r, \ .vr<'--" o ^ -» > - . rv \- 

20 In FIGURE 10b, the unprocessed packet is shown generally at 1020. Here, fti&'e is no dataiffeld between the tfclhdf 

1001 J andthe pic_start_Code 1003. In accordance With the present We'fttion; aS ihoWnat 103b;the entire packef 1020 
is not transmitted since there would be no data fields remaining after discarding the second data field 1004- ' 1 

Now, the process of blocks 51 6 and 546 will be discussed,- vvheteih the first packet of the main stream after the sec- 
ond splicing point (e.g., sprout), is processed to maintain compliance with 1 the MPEG or similar fcomrhunication proto 1 

25 col. This first packet-will be referred to as a post-splicing data packet:* As with the pre-splidlhg palrfket; processing of the ; ' 
post-splicing packet is treated differently depending on whether the packet has an adaptation fteld and a PE3 header, 
and further depending on th6 locationof data fields in the packet. In particular, the "first -post-splicing packet must be 
processed by the syntax processor 470 when the splicing point does not correspond exactly to a pi&tlire boundary. In 
this case, the post-splicing packet may contain part of the data from a previous picture or sequence of pictures. - 

30 In accordance with the present inventidh, the pbst-spli&ng packet is fixed by discarding the tfafa ff"o'm i trte ! pr&vf6u^ , *' 
sequence* and Stuffing a^compensating number of durnmy bytes to the adulation fteldbf th^pd^-SpItdihg; jSackel. Ftfr- r 
therrndr^fan adaptation^ te>fc*i$ cteated if it does rioi'afead^exist. Moreover; as'^fh Ihe'prbcdisang 6f the pre-splicing 
packed t'r^nformati^^ '"■*'•■ & ' ~; ; 

adaptation_field_length, / 

35 payloao^unitjstartiindidator; JengthY arid fcther ^arairhet^rs,' ri&y be changed, but this is no expected to result in 
any vfeible discontinuity oT artifacts to the vi^wef^h^h the data fedispfey^. f ^" <^ *■ O - n * - 

FIGURES 1 1&M'1d show a pos^lidng data packet s and after 

processing in accordance with the present invention. In FIGURE 11a, the packet; shown genially before processing at 
1 100/inctuaes a-transporf header 1101 •; ah adaptation field 1 lb2 carrying K byteSV a firsTdafa field 1103 carrying N 

40 bytes, a PES header, pesjidr llb4,^J9dcond*data ffSld-f I05ca:rryirig Mbytes, a sequence sfartcode 1 106 and a third 
data field tl 07. Irvthis case, it can be seen that there is data carried between the&daptationj retd 1 102 arid the p£s_hdr 
1104;arKlbetweeomepfes„hdM^^ T "" - "^=- * 

Moreover, the Seq_start^code 1 106\defines the starfof a new se^uSnte of pictures, arid the first data field 1-103 
and the second data f ieHd 11 05 carry data of & picture from a previous sequence. Thus, in accordance with the present 

45 invention the packet 1 1 00 is processed by discarding the first data field 1 1 0 and the second data field 1 1 05, and stuffing' 
N+M dummy bytes tnlhe^adaptatiorvfield'1 102. This results in the processed packet WW which included the adapta- 
tiortfield 1 U2. The packet 1 1-10 includes data from only one sequence* of pickires^arkiddes.not require the r previous 5 ' 
adjacent packet- to maintaifi continuity.'* J :*-r-" o; ~ ! 1 -"'■*'■ . ' ~" 'y ] 

In FIGURE 1 1*b, the Unpr€icessedpa^t is shown geherafly at 1 1 20-, artd the prbce*ssed packet is : shown generally 

so at 1 130; Her£, there data bd^Ueeri ttoe adapt&tionJielcT 1102 and thte peVhdr 1 104 ; but not between the p£s£hdr 
1 104 anct1h^se(iist^rt_code 1106. In accdrdancew^tfi the present iriveribon. -Hie packet 1 120 is processedby dibca'rcJ^ 
ing the firstdata fletd: 1103, and stuffirigM ctomrty bytes into fftei-rfdaptaSibri field T1 02. This results in the processeo' 
packet nsO'V/hibh included the adaptation fiSfcW 132. - ': ^ =. o*r- . : ~ ! *■: . r. - - \ ro 

Int FIGURE- 1 1c, the unprotested packet 1s* shown geherally'at 1 l^ancRhe processed packet is shdwn generally 

55 at 1 15'Ofi' Here, ther« ^4ss dataib6ftv.^enf the pes_hdr 1104"€(rid the^* 6ecLstart£icode "1106? but not'betwfeen the- 
adaptationjield 1102.and" the p^esJ^^dr:;1104. , In stbcoftlance with the present invention,' the jacket 1140" \s processed 
by discardingthe second data field 1105, and«stuffirig : M durrirny bytes in the adajDtatibh-fie!G'11C2: " this results irfthe 
processed packet 11 50 which includes; the adaptationjield 11 52? : * • " J ' % 1 ' • - - 
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In FIGURE Hd, the unprocessed packet is shown generaliy..at=1160..Hererihere is no data field between the 
pes_hdr 1 1 04 and the seq_start_code 1 1 1 06, or between the adaptationjield 1 102 and the pesjidr 1 1 04. In accord- 
ance with the present invention, the entire packet 1 160 is transmitted without modification since there is no data field 
prior to the seq_start_code 1 106. 

s FIGURES 1 2a and 1 2b show a post-splicing data packet having an adaptation field but no PES header before and 

after processing in accordance with the present invention: In FIGURE 12a, the unprocessed packet is shown generally 
at 1200, and the processed packet is shown generally at 1210. Here, there is data between the adaptation field 1202 
and the secL_start_code 1 204. In accordance with the present invention, the packet 1200 is processed by discarding the 
first data field 1203 and stuffing N dummy bytes in the adaptation field 1202. This results in the processed packet 1210 
10 which includes the adaptation field 1212.^ : 

. In FIGURE 1 2b, the unprocessed packet is shown generally at 1220. Here, there is no data field between the adap- 
tation field 1202 $nd the seq_start_code 1204. In accordance with the present invention, the entire packet 1220 is 
transmitted without modification since there is no data field prior to the seq_starTcode 1204. 

FIGURES 1 3a-13d show a post-splicing data packet having-np adaptation field but with a PES header before and 
is after processing in accordance with the present invention. In FIGURE 13a, the packet, shown generally before process- 
ing at 1300, includes a transport header 1301, afirst data field 1302 carrying N bytes, a PES header 1303, a second 
data field 1304 carrying M bytes, a sequence start code .1305 and a third data field 1306. In this case, it can be seen 
that there is data carried in the packet 1300 between theipjidr 1-301. and the pesjidr t303. and between the pesjidr 
1 303 and the seq_start_code 1 305. In accordance with the present invention the packet 1300 is processed by discard- 
20 ing the first data field 1302 and the secondrdata field 1304,' and creating an adaptation- field 1312 with N+M dummy 
bytes as shown in the processed packet 1310. 

In FIGURE 13b, the unprocessed packet is shown generally at 1320, and the processed packet is shown generally 
at 1 330. Here, there is data between the tpjidr 1 301 and the pesjidr 1 303, but not between the pesjidr 1 303 and the 
seq_start_code 1305. In accordance with the-present invention, the packet 1320 is processed by discarding the first 
25 data field 1302, and creating an adaptationifield 1322 with N dummy bytes, as shown in the processed packet 1330. 

In FIGURE 13c. the unprocessed packet is shown generally at 1340, and the processed packet is shown generally 
at 1 350. Here, there is data between the pesjidr 1 303 and the seq_start_code 1 305. but not between the tpjidr 1301 
and the pesjidr 1303. In accordance with the present invention, the packet 1340 is processed by discarding the sec- 
ond data field 1304, and creating an adaptation field 1352 with M dummy bytes, as shown in the processed packet 
30 1350 - E-c<b>. : :Oa ;:r , .n - ■ ~? , , " x. .. : • 

In FIGURBv13d;cthe^unprcc^$sed packet is shown generally at 1360. Here, there is : no data- field between the 
tpjidr 1301 and the pesjidr :1303, or between the pes„hdr ( 1303 and-the seq-start_code 13Q5. ^accordance wiih the 
present invention, the entire packet 1360 is transmitted without modification since there is no data field prior to the 
seq_jstart_code..1305. : v.jh<- ;y. v^r V (>■-.-.. v'^-^c- - mttl% >, ... . t - ; ; - n 

35 FIGURES 1 4a and 14b show a post-splicwng datapacket;baving no adaptation field or PES header before and after 
processing in accordance with the present invention. In this case, an adaptation field is created which carries the 
dummy stuffing bits^whiqh account for the discarded fields. In FIGURE.-1 4a, the. unprocessed packet is shown generally 
at 1400, and the processed packet isshowrt generally at 141 Q. Here^ there is datatietween-the tpjidr 1401 and the 
seq_start_code 1403. In accordance with the present invention, the packet 1400 is processed by discarding the first 
40 data field 1402, and creating an adaptation field 1412 with N dumm/bytes-,- as shown m the* processed packet 1410.". 

In FIGURE 1 4b, the unprocessed packet is shown generally at 1 420. Here, there is no data field between the tpjidr 
1401 and the seq_startcode 1403. In accordance with ^the present-invention, the entire packet 1420 is transmitted 
without modification since there isxio data f ieidprior to the seq_start_code 1403. . i} 

A decoder for decoding the output data stream may be provided as discussed earlier in connection with FIGURE 
45 1 . For example, the Digital Entertainment Terminal (DEJ)i168 can include a decoder with anassociated data buffer and 
processor. The buffer receives the incoming data stream and provides the data to the processor for decoding and other 
processing which is required- to provide a signal suitable for reproduction on a television;. As discussed, the provision of 
null packets in the output data stream will prevent a potential buffer overflow at the decoder. - 1 ' o„ 

Accordingly, it<can be seen that the present invention provides a method and apparatus, for splicing compressed 
so packetized digital video streams. In particular, a secondary packetized data stream, such as a commercial, is spliced 
with a primary packetized data jstream; such as a network television program. The system does not require the decom- 
pression of the data in the primary data stream, and is particularly-suitable tot use at a.eable system headend to allow 
the insertion of commercials from local businesses into a nationally broadcast television program. 

Although the invention has been described in connection with various specific embodiments, those skilled in the art 
55 will appreciate that numerous adaptations and modifications maybe;rnade thereto without departing from the spirit and .» 
scope of the invention as set forth in the claims. For example, it is possible to locate the IPU in the decoder at the sub- 
scriber's home, thereby providing the sybscr iber withJbe capabilities of a in-home digital data mixer such as, those used 
at television, ra^iio and recording studios. TJiis would allow:the:$tbscriber.tq edit various audio, video and data sources. 
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For example, data stored on a DVD or CD-ROM could be spliced with a main program for various educational and enter- 
tainment purposes. r *'' • - - J * " - - - *- • - "' « 

Claims • ' r ' • " ':. 

1. A method for splicing 'a' secondary packetized 1 data stream with a primary papketized data stream, comprising the * 
steps of: ' ' '\ . .. i! '-, -•;.*.• • . ' -* - : • 

providing a start signal indicating a timelo initiate said- splicing; - w -» r '/ *- = : 

w determining a pre-splicing packet of said primary stream according to said start' signal; and ». • 

providing an output stream where a first packet of said secondaty streartvis positioned to follow said pre-splic- 
* ing packet ~ C ~ ~ r ^ ' ■ : 

2. A method in accordance with claim 1 , wherein the packets bf said primary 'Stream have identifying data associated 
75 therewith, comprising the furthersteps. of : r . ; ' «v - ;.. '" . 1 :\. * 

. , - • c \ u--:. r ..-..:r:\- f , *i .* ■■ " - 

- retrieving said identifying data of said prirriary ! strearh; and: "' :\- - . 

- ' ! 'providing said secondary stream with said identifyirig„data;= ^ vv OO.'m ^r;- • ; * *~ .< • ' 

~. r: J," ■ , o-r . • .-■ , v^.j^ 5-.'? *.■.: n! ,:,Cc ! c.i " v. i ■ 

20 3. A" method in accordance 'with claim 1 or 2, comprisingthe furthierstepscof: " ^ - : - " • '^o^ 1 - - - 

providing a number L of null packets in said output stream to prevent a buffer ^overflow at a^ decoder which 
receives said'output stream; and . * - ^ . h-. n C :J* \ . *r*. c. *v. - -* 

inserting said nu I Ipackets between said pre-splicing packet. and!$aid l first packet; % r' - . " ?, --. 
25 wherein said' number L is determined according to respective data* rates of said primary 2nd secondary^ • '• 

Streams.': ; 'v>: • ) j :je' - 

4. A method in accordance with one of the preceding claimsf comprising the further steps of * 

30 determining a post-splicing packet of said primary stream which follows said pre-splicing packet; _. - ^ ! 

: discardingdataof said pre-splicing packet which^is associated with said pbs^spiid^ 

&r:i redding ah &ritouht"t*f Stuffing data tc^saidipre-spfi&ihg packet according' to the amount of data discarded^ c * 

5. A method in accordance with one of the preceding claims, wherein said pre-splicing packet is a packet of saidpri- 
35 mary stream with an anchor frame start cod^which is dlosest to said start time; *: , ; ' ' fc r . 

: . - "! t ..v LMB'* .j . i. , iCLt'Cr-bi 6'j c 1 r "oi:f r-t : -?r^ "J^ xcvcr . q^j. . 

6. ^method in accbrdance with dttexrtthe precteding diaimsi 1 ^ wherein ^aid -primary stream carries compressed 'digital*'-' " 
data, and said "splicing does notrequire decompression of ^aid compressed digttal datia; ' ^ : r , .0 

vt'.fi "o . ".'j- a; .\ 5; 0^ ' - : " - ' '*<>•• ^"o ^r*- i ■ ■ -v e r.^*-- ,-. * • ' ■-: 

40 7. A method in Bccbrdantei with one of the:preceding Claims, comprising the furthenstepsof: ^ 

' ! "" - . .:r . H OSv-: J£ 2 3. '-^ ;. • ^'-b ? v^' .'aj 

"cTetermiiiihg a post-splicing=paCket of said^irrtsry stream which*fo1laws said pr^-splicing packet; and l = 

positioning said post-splicing packet to follow & last packet of^saictsecortdkry'stream inlaid output stream. 
'- \i" r m*-;;c 1!"-' . h-Mv ' i-.i ; i r r; f -n' t -i 

45 8. A method in accordance' with; claim '7, "Composing the iurth^ steps of ■= *n? 0 ; v-.r 
. " *■ j' ~ ^ ' - . v .. : t ^"e c ■• ' : . "~ r.- -^'Vi 

• % discarding data of said'post-fcplicing packet which Js associated wrth ^ pabketiof s^d primafyi^ream which 
immediately precedeffsaid pbst-splicing packet; and :^ 3V ^ * ' •: : ' ^ r : ' I } ' r > 

- ? "addirtg an amount of stuffing data to said post^spliclng packet accordiPtg to the amount of ddfa discarded. 
so :•;*■'•*•■... » ."'.j *?; ■ r- > : h .p. \ . jZ-'^ ^ > ; c:;" .■••>: .-.^ 1 . . vtJ: 

9. A method in accordance with claim 7 or 8/ ^wherein saidpo^t-splicirtg packet arpacket of said primary stream with' ; • » 
a sequence sfartfoode which directly foHows a sequence end cocfe*whichhts associated with saidlast packet of skid^ r 
secondary stream. 3- ^ ./ ^ r 3 " ! " ^ = ■ ^ - n» ^- 

" . * •. "i* '}! ,j; ^or'; r.i. * : ? rj-j..^*/^ ... . ir^o-i ■>"*«■* . ■ ;-r-* : -s 1 *' ^r-.\ 

55 10. ' Art apparatus^ splteing a secondary packetized data stream with a primary^pac^etizec^data; comprising:-^ ' ^ 

I- • * ' j:,3b£ '.i * ■ *- . j r •. ^i; K - ! . 3 .v , :' l f-,s. 

means for providing a start signal indicating a time to- initiatelsaid splicing; - - ' ^ - . : 

means for determining a pre-splicing pactoei of^s^d primary stream according to said start signal^ 1 and - : r : - 
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• means for providing an output stream where a first packet of said secondary stream is positioned to follow said 
pre-splicing packet. . : 

1 1 . An apparatus in accordance with claim 1 0, wherein the packets of said primary stream have identifying data asso- 
5 ciated therewith, further comprising: 

means for retrieving said identifying data of said primary stream; and 
means for providing said secondary stream with said identifying data. 

10 1 2. An apparatus in accordance with claim 1 0 or 1 1 , further comprising: 

means for providing a number L of null packets in said output stream to prevent a buffer overflow at a decoder 
which receives said output stream; and 

means for inserting said null packets between said pre-splicing packet and said first packet; 
75 wherein said number L is determined according to respective data rates of said primary and secondary 

streams. 



13. An apparatus in accordance with one of claims 10 to 12, further comprising: 

means for determining a post-splicing packet of said primary stream which follows said pre-splicing packet; 
means for discarding data of said pre-splicing packet which is associated with said post-splicing packet; and 
means for adding an amount of stuffing data to said pre-splicing packet according to the amount of data dis- 
carded. 



25 14. An apparatus in accordance with one of claims 10 to 13, wherein said pre-splicing packet is a packet of said pri- 
mary stream with an anchor frame start code which is closest to said start time. 

15. An apparatus in accordance with one of claims 10 to.14, wherein said primary stream carries compressed digital 
data, and said splicing does not require decompression of said compressed digital data 

30 

16. An apparatus in accordance with one of claims 10 to 15, further comprising: 

means for determining a post-splicing packet of said primary stream which follows said pre-splicing packet; 
and 

35 means for positioning said post-splicing packet to follow a last packet of said secondary stream in said output 

stream. 



40 



45 



50 
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17. An apparatus in accordance with claim 16, further comprising; 

means for discarding data of said post-splicing packet which is associated with a packet of said primary stream 
which immediately precedes said post-splicing packet; and 

means for adding an amount of stuffing data to said post-splicing packet according to the amount of data dis- 
carded. 

18. An apparatus in accordance with claim 16 or 17, wherein said post-splicing packet is a packet of said primary 
stream with a sequence start code which directly follows a sequence end code which is associated with said last 
packet of said secondary stream. 

19. A decoder for decoding a transport data stream which comprises a secondary packetized data stream which is 
spliced with a primary packetized data stream, wherein a first packet of said secondary stream is positioned to fol- 
low a pre-splicing packet of said primary stream, said decoder comprising: 

a buffer for storing said transport data; and 

a processor coupled to receive data from said buffer for processing said transport data; wherein: 
a number L of null packets are provided between said pre-splicing packet and said first packet to prevent over- 
flow of said buffer; and 

said number L is determined according to respective data rates of said primary and secondary streams. 
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20. A decoder in accordance with claim 19, wherein said number L is determined according to a decoding delay time 
of said decoder. 
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(57) A secondary packetized data stream (IS), such 
as a commercial, is spliced with a primary packetized 
data stream (MS), such as a network television pro- 
gram. The system does not require decompression of 
the data in the primary data stream, and is particularly 
suitable for use at a cable system headend to allow the 
insertion of commercials from local businesses into a 
nationally broadcast television program. When a start 
signal (T_in)is received, a pre-splicing packet (700, 800, 
900, 1 000) of the primary stream is determined. The pre- 
splicing packet is the packet closest to the start time 
which carries an anchor frame (e.g., I or P frame) start 
code (706, 804, 905, 1003). To prevent a potential dis- 



continuity at the decoder (168), the pre-splicing packet 
(700, 800, 900, 1 000) is processed to discard the anchor 
frame data, and to insert a number of stuffing bytes (712, 
812, 912, 1012) which is equal to the number of bytes 
discarded into an adaptation field of the pre-splicing 
packet. To further maintain continuity at the decoder, 
identifying data of the primary stream such as PID and 
PS I data, is retrieved and provided to the secondary 
stream. A number of null packets (430) are inserted into 
the output stream (OS) at the transition point between 
the main program and the commercial to prevent a buff- 
er overflow at a decoder (1 68) which receives the output 
stream (OS). 
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